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Budget Feasible Mechanism Design: From Prior-Free to Bayesian 
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^^ ■ Abstract 

(N 

Budget feasible mechanism design studies procurement combinatorial auctions in which the sellers 
C^ , have private costs to produce items, and the buyer (auctioneer) aims to maximize a social valuation 

function on subsets of items, under the budget constraint on the total payment. One of the most 
important questions in the field is "which valuation domains admit truthful budget feasible mech- 
^— ^ ' anisms with 'small' approximations (compared to the social optimum)?" Singer j35| showed that 

additive and submodular functions have a constant approximation mechanism. Recently, Dobzinski, 
Papadimitriou, and Singer j20j gave an 0(log n) approximation mechanism for subadditive func- 
pH , tions; further, they remarked that: "A fundamental question is whether, regardless of computational 

rn ' constraints, a constant-factor budget feasible mechanism exists for subadditive functions. " 

ly! , In this paper, we address this question from two viewpoints: prior-free worst case analysis and 

O ' Bayesian analysis, which arc two standard approaches from computer science and economics, respec- 

tively. 

• For the prior-free framework, we use a linear program (LP) that describes the fractional cover 
of the valuation function; the LP is also connected to the concept of approximate core in coop- 
erative game theory. We provide a mechanism for subadditive functions whose approximation 
^^ ' is 0{X), via the worst case integrality gap T of this LP. This implies an 0(log ri)-approximation 

^^ . for subadditive valuations, 0(l)-approximation for XOS valuations, as well as for valuations 

having a constant integrality gap. XOS valuations are an important class of functions and lie 
f^ , between the submodular and the subadditive classes of valuations. We further give another 

CN ' polynomial time 0( j^°^"^ ) sub-logarithmic approximation mechanism for subadditive func- 

tions. 
Both of our mechanisms improve the best known approximation ratio 0(log n). 

K^ ' • For the Bayesian framework, we provide a constant approximation mechanism for all subad- 

\^ , ditive functions, using the above prior-free mechanism for XOS valuations as a subroutine. 

_^_' Our mechanism allows correlations in the distribution of private information and is universally 

truthful. 
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1 Introduction 

Consider a procurement combinatorial auction problem where there is a buyer who wants to purchase 
resources from a set of agents A. Each i £ A is able to supply a resource at an incurred cost c{i). 
The buyer has a sharp budget B that gives an upper bound on the compensation that is distributed 
among agents, and a function v{-) describing the valuation that the buyer obtains for each subset of 
A. This defines a natural optimization problem: find a subset S ^ A that maximizes v{S) subject to 
SieS ''(^) — ^' "^^^ budgeted optimization problem has been considered in a variety of domains with 
respect to different valuation functions, e.g., additive (a.k.a. knapsack), and submodular j37j . 

Agents, as self-interested entities, may want to get as many subsidies as possible. In particular, an 
agent can hide his true incurred cost c{i) (which is known only to himself) and claim 'any' amount b{i) 
instead. We adopt the approach of mechanism design to manage self-interested, but strategic, behaviors 
of the agents: Given submitted bids b{i) from all agents, a mechanism decides a winning set S Q A and 
a payment p{i) to each winner i G S. A mechanism is called truthful (a.k.a. incentive compatible) if for 
every agent it is a dominant strategy to bid his true cosIg, i.e., b{i) = c{i). Truthfulness is one of the 
central solution concepts in mechanism design. It ensures that every participant will behave truthfully 
to his best interest. 

Our mechanism design problem has an important and practical ingredient: the budget, i.e., the 
total payment of a mechanism should be upper bounded by B. The budget constraint introduces a new 
dimension to mechanism design and restricts the space of truthful mechanisms. For example, in single- 
parameter domains where the private information of every individual is a single value (which is the case 
in our model), a monotone allocation rule with associated threshold payments provides a sufficient and 
necessary condition for truthfulness |31] . However, it may not necessarily generate a budget feasible 
solution. Thus, a number of well known truthful designs (e.g., the seminal VCG mechanism [38 1 116 1 [M]) 
do not apply, and new ideas have to be developed. 

Another significant challenge due to the budget constraint is that, unlike the VCG mechanism which 
always generates a socially optimal solution, we cannot hope to have a solution that is both socially 
optimal and budget feasible even if we are given unlimited computational power. Indeed, in a simple 
setting like path procurement with or 1 valuation |35j . any budget feasible mechanism may have an 
arbitrarily bad solution. Therefore, the question that one may ask is "under which valuation domains 
do there exist truthful budget feasible mechanisms that admit 'small' approximations (compared to the 
socially optimal solution)?" 

The answer to this question crucially depends on the properties and classifications of the valuation 
function under consideration. In particular, given the following function hierarchy [29]: 



additive C gross substitutes C submodular C XOS C subadditive, 

which one admits a positive answer? Singer [35] initiated the study of approximate budget feasible 
mechanism design and gave constant approximation mechanisms for additive and submodular functions. 
In subsequent work, Dobzinski, Papadimitriou, and Singer [20] considered subadditive functions and 
showed an 0(log n) approximation. Further, it was remarked in |20[ that: 

"A fundam,ental question is whether, regardless of computational constraints, a constant- 
factor budget feasible mechanism exists for subadditive functions. " 

— Dobzinski, Papadimitriou, Singer 



^The focus of our work is to consider strategic behaviors of the agents rather than the buyer. We thus assume 
that the information related to the buyer, i.e., budget B and valuation function w(-), is public knowledge. 



In the present paper we attempt to answer this question. 

1.1 Our Results and Techniques 

We address this question from two viewpoints: prior-free worst case analysis and Bayesian analysis. The 
former is the standard framework used in computer science: in our model, the private cost c(i) of every 
agent is assumed to be arbitrary without any prior knowledge. All previous research on budget feasible 
mechanism design, e.g. [35^ HM [20} [22] falls into this framework. The latter Bayesian analysis [31] is 
a classic economic approach that assumes the private information of the agents is drawn from a given 
prior-known distribution. Bayesian mechanism design has received a lot of attention in the computer 
science community in recent years, see, e.g. , [27l[28l[26l[7l[TT][T8l[T3l[25|[5][T2][T7]. 

Prior-free mechanism design Consider the following linear program (LP), where a(-)'s are vari- 
ables. 

min y^ a{S) ■ v{S) 
SCA 

s.t. a{S) > 0, y S CA 

Y, a{S) > 1, yieA 
S: ies 

Constraints of this LP describe a fractional set cover of A, where each set S receives weight a{S) 
and we require that all agents in A are covered. An important observation about this LP is that for 
any monotone subadditive function v{-), the value of the optimal integral solution is precisely v{A). 

The above LP has a strong connection to the core of cost sharing games (considering v{-) instead as 
a cost function) , which is a central notion in cooperative game theory [33] . Roughly speaking, the core 
of a game is a stable cooperation among all agents to share v(A) where no subset of agents can benefit 
by breaking away from the grand coalition. It is well known that the cores of many cost sharing games 
are empty. This motivates the notion of a- approximate core, which requires all the agents to share 
only an a-fraction of v{A). The classic Bondareva-Shapley Theorem [9] [34] says that for subadditive 
functions, the largest value a for which the a-approximate core is nonempty is equal to the integrality 
gap of the LP. Further, the integrality gap of the LP equals one (i.e., v{A) is also an optimal fractional 
solution) if and only if the valuation function is XOS, which is also equivalent to the non-emptiness of 
the core. 

Given an instance of our problem with an agent set A, we may consider the above LP and its 
integrality gap for every subinstance A' C A. We denote X as the largest integrality gap among all 
subinstances A' C A. In other words, the gap I characterizes the worst case scenario between the 
optimal integral and fractional solutions of the problem. We have the following result. 

Theorem 1. There is a budget feasible truthful mechanism for subadditive functions with approximation 
ratio 0{X). In particular, for XOS functions, the mechanism has a constant approximation ratio. 

Our results show an interesting connection between the budget feasible mechanism design and the 
integrality gap of the above linear program, as well as the existence of an a-approximate core. Note that 
the tight bound of the integrality gap is known to be 0(logn) [191 [8]: thus, our mechanism in the worst 
case has an approximation ratio of O(logn). (But for some special functions whose integrality gaps 
are bounded by constants, e.g., facility location [33], our mechanism gives a constant approximation.) 
Further, the mechanism may have exponential running time, though for some special XOS functions 



like matching it can be implemented in polynomial time. To remedy these issues, we further give a 
polynomial time sub-logarithmic approximation mechanism. Both of our mechanisms improve the best 
known approximation ratio 0(log n) of |20j . 



Theorem 2. There is a polynomial time budget feasible truthful mechanism, for subadditive functions 
with an approximation ratio 0( ^^°^"^ ), where n is the number of agents. 

Bayesian mechanism design As a standard game theoretic model for incomplete information, 
Bayesian mechanism design assumes that agents' private information (i.e., c{i) in our model) is drawn 
from a known distribution. In contrast to prior-free worst case analysis, if we have prior knowledge of 
the distribution, we can obtain more positive results in the form of constant approximation truthful 
mechanisms. In the Bayesian setting, we are able to answer the above question posed in [20] affirma- 
tively. 

Theorem 3. There is a constant approximation budoet feasible truthful mechanism for subadditive 
functions for any distribution under a mild assumptior^. 

It should be noted that our result does not completely rely on Bayesian analysis in the following 
aspects. 

• Truthfulness. In most of the previous works in Bayesian mechanism design regarding social welfare 
maximization, e.g., |26 t [5| [25l 112] . the considered solution concept is Bayesian truthfulness, i.e., 
truth-telling is in expectation an equilibrium strategy when other agents' profiles are drawn from 
the known distribution. Our mechanism guarantees universal truthfulness, meaning that truth- 
telling is a dominant strategy of each agent for any coin fiips of the mechanism and any instance of 
the costs. Thus universal truthfulness is a stronger solution concept than Bayesian truthfulness. 
Universal truthfulness in Bayesian mechanism design has also been used in, e.g. [11], but their 
focus was on profit maximization. 

• Distribution. Regarding prior knowledge of the distribution, most of the previous related works 
consider independent distributions, e.g., \n \ \2G \ [5| 125]. Our mechanism applies to general dis- 
tributions that allow correlations on costs. Dependency on private information is a natural phe- 
nomenon arising in practice and it has been considered for, e.g., auctions |30] . In our model where 
costs are private information, correlations appear to be very common. For example, if the price 
of crude oil goes up, the costs of producing the items for all agents may go up as well. 

Techniques In the design of budget feasible mechanisms, the major approach used in previous 
works [35l [HI [20] is based on a simple idea of adding agents one by one greedily and carefully en- 
suring that the budget constraint is not violated. Our mechanisms, from a high level structural point 
of view, use another simple, but powerful, approach: random sampling. We add agents into a test set T 
with probability half for each agent and compute an (approximately) optimal budget feasible solution 
on T. We use the agents in T only for the purpose of 'evaluation' and none of them will be a winner. 
The computed solution on T gives a close estimate of the optimal solution for the whole set with a high 
probability. We then compute a real winning set from the remaining agents using the evaluation from 
r as a threshold. 



^Technically, we require that the distribution has integrable marginal densities for any subset of variables (e.g., 
jointly independent distributions trivially satisfy this condition). The formal definition is referred to Section U) 



In the Bayesian setting, random sampling is often deemed to be unnecessary, because, when we have 
knowledge of the distribution, it is tempting to use a 'prior sampling' approach to generate random 
virtual instances and based on them to compute a threshold. While this works well when the private 
cost c{i) of every agent is drawn independently, interestingly (and surprisingly), it fails when costs 
c(i)'s are correlated in the distribution. We therefore still use random sampling to compute a threshold 
based on the sampled test set; the collected information from random sampling correctly reflects the 
structure of the private costs (with a high probability) even for correlated distributions. To derive a 
constant approximation budget feasible mechanism for subadditive functions, we first generate a cost 
vector sampled from the known distribution and use it as a guidance for the payments to the winners. 
Then we adopt our (constant approximation) mechanism for prior-free XOS functions by feeding to 
this mechanism another valuation v{-), which we define as the solution of the above LP computed for 
the various subsets of A. 

Random sampling appears to be a powerful approach and has been used successfully in other 
domains of mechanism design, e.g., digital goods auctions [23], secretary problem [3l|2], social welfare 
maximization [19], and mechanism design without money [15]. It is intriguing to find applications of 
random sampling in other mechanism design problems. 

1.2 Related Work 

Our work falls into the field of algorithmic mechanism design, which is a fascinating area initiated by 
the seminal work of Nisan and Ronen [32]. There are many mechanism design models; see, e.g., [33], 
for a survey. 

As mentioned earlier, the study of approximate mechanism design with a budget constraint was 
originated by Singer [35] and constant approximation mechanisms were given for additive and sub- 
modular functions. The approximation ratios were later improved in J14j . Dobzinski, Papadimitriou, 
and Singer [20] considered subadditive functions and showed an 0(log n) approximation mechanism. 
Ghosh and Roth |22j considered a budget feasible mechanism design model for selling privacy where 
there are externalities for each agent's cost. All these models considered prior-free worst case analysis. 

For Bayesian mechanism design, Hartline and Lucier [26] first proposed a Bayesian reduction in 
single-parameter settings that converts any approximation algorithm to a Bayesian truthful mechanism 
that approximately preserves social welfare. The blackbox reduction results were later improved to 
multi-parameter settings in [5] and [25] independently. Chawla et al. [12] considered budget-constrained 
agents and gave Bayesian truthful mechanisms in various settings. A number of other Bayesian mecha- 
nism design works considered profit maximization, e.g., |27^ \7\ [T3l \TE[ \TT\ I17j . Ours is the first to 
consider Bayesian analysis in budget feasible mechanisms with a focus on the valuation (social welfare) 
maximization. 

2 Preliminaries 

In a marketplace, there are n agents (or items), denoted by A. Each agent i £ A has a privately known 
incurred cost c{i) > 0. We denote by c = (c(i))jgA the cost vector of the agents. For any given subset 
5 C ^ of agents, there is a publicly known valuation v{S), meaning the social welfare derived from S. 
We assume that f (0) = and the valuation function is monotone, i.e., v{S) < v{T) for any S CT Q A. 
A centralized authority wants to pick a subset of agents with maximum possible valuation given a sharp 
budget B to cover their incurred costs, i.e., max^^^ t>(5) given c{S) = J2ies '^i''') — ^- ^^ denote the 
optimal solution of this optimization question by opt(^) (or opt(c)) and its valuation by v{opt(A)). 



We will consider XOS and subadditive functions in the paper; both are rather general classes 
and contain a number of well studied functions as special cases, e.g., additive, gross substitutes, and 
submodular. 

• Subadditive (a.k.a. complement free): v{S) + v{T) > v{S U T) for any S,T C A. 

• XOS (a.k.a. fractionally subadditive): there is a set of linear functions fi, ■ ■ ■ , fm such that 

viS)=ms.x{MS),f2iS),...,UiS)} 

for any S Q A. Note that the number of functions m can be exponential in n = \A\. 

An equivalent definition [21] is v{S) < J^tca^C^) ' ^C^) whenever YItca- ieT^C^) — -*- ^°^ ^^^ 
i € 5", where < x{T) < 1. That is, if every element in S is fractionally covered, then the sum of 
the values of all subsets weighted by the corresponding fractions is at least as large as v{S). 

Note that the representation of a valuation function usually requires exponential size in n. Thus, we 
assume that we are given an access to a demand oracle, which, for any given price vector p(l), . . . ,p{n), 
returns us a subset T e argmax^^^ (^(5') — Z^iG5P(^))' ^very such query is assumed to take unit time. 
The demand oracle is used in [20] as well, and it was shown that a weaker value query oracle is not 
sufficient [35] . 

Agents, as self-interested entities, have their own objective as well; each agent i may not tell his true 
privately known cost c{i), but, instead, submit a bid b{i) strategically. We use mechanism design and 
its solution concept truthfulness to manage strategic behaviors of the agents. Upon receiving b{i) from 
each agent, a mechanism decides an allocation S C A of the winners and a payment p{i) to each i € A. 
We assume that the mechanism has no positive transfer (i.e., p{i) = if i ^ S) and is individually 
rational (i.e., p{i) > b{i) if i € 5). 

In a mechanism, agents bid strategically to maximize their utilities, which is p{i) — c{i) if i is a 
winner and otherwise. We say a mechanism is truthful if it is of the best interest for each agent to 
report his true cost, i.e., b{i) = c{i). For randomized mechanisms, we consider universal truthfulness 
in this paper: a randomized mechanism is called universally truthful if it takes a distribution over 
deterministic truthful mechanisms. 

Note that our model is in a single parameter domain, as each agent has only one private parameter 
which is his cost. Thus, by the well known characterization of single parameter truthful mechanisms [31j . 
designing a monotone allocation, plus the corresponding threshold payment rule, is sufficient to derive 
a truthful mechanism. We therefore do not specify the payments to the winners in our mechanisms 
explicitly. 

A mechanism is said to be budget feasible if its total payment is within the budget constraint, i.e., 
^iPii) < B. Our goal in the present paper is to design truthful and budget feasible mechanisms for 
XOS and subadditive functions in two frameworks: prior-free and Bayesian. 

We first establish the following technical lemma, which is useful in the analysis of our mechanisms. 

Lemma 2.1. Consider any subadditive function v{-). For any given subset S Q A and a positive 
integer k, we assume that v{S) > k ■v{i) for any i S S". Further, suppose that S is divided uniformly at 
random into two groups Ti and T2. Then, with probability of at least g, we have v{Ti) > --^v{S) and 
v{T2) > ^v{S). 



3 Prior-Free Mechanism Design 

In this section we consider designing budget feasible mechanisms for XOS and subadditive functions 
in the prior-free setting. That is, the mechanism designer has no prior knowledge of the private 
information c(i) of every agent, which can be an arbitrary cost, and the performance of a designed 
mechanism is analyzed in the worst case framework. That is, we evaluate a mechanism according to 
its approximation ratio, which is defined as maxe ^ j^(c] : where Ai{c) is the (expected) value of a 
mechanism A4 on instance c = (c(i))jgA and t)(opt(c)) is its optimal value. (We assume without loss 
of generality that c{i) < B for any i ^ A, since such an agent will never win in any budget feasible 
truthful mechanism.) 

3.1 Constant Approximation for XOS 

We will first consider XOS functions. Given an XOS function v{-), by its definition, we assume that 

i;(S) = max{/i(5),/2(5),...,/™(S)} 

for any S '^ A, where each /,(•) is a nonnegative additive function, i.e., fj{S) = "Yli^s hi^)- 

In our mechanism, we use a random mechanism Additive-mechanism for additive valuation func- 
tions as an auxiliary procedure, where Additive-mechanism is a universally truthful mechanism and 
has an approximation factor of at most 3 (see, e.g., Theorem B.2, |14j). 



XOS-RANDOM-SAMPLE 

1. Pick each item independently at random with probability 2 into group T. 

2. Compute an optimal solution opt(r) for items in T given budget B. 

3. Set a threshold t = "^°gg^" ■ 

4. Consider items in A\T and find a set 5** G argmax |t;(S') — t • 0(5")}. 

S<ZA\T 

5. Find an additive function / with f{S*) ~ v{S*) in the XOS representation of w(-). 

6. Run Additive-mechanism for function /(•) with respect to set S* and budget B. 

7. Output the result of Additive-mechanism. 



In the above mechanism, we first sample in expectation half items to form a testing group T, 
and compute an optimal solution for T given budget constraint B. By Lemma 12.11 we know that 
v{opt{A)) > v{opt{T)) > ■^-y(opt(^)) and v{opt{A\T)) > ^v{opt{A)) with a probability of at 
least 2- That is, we are able to learn the rough value of the optimal solution by random sampling, and 
still keep a nearly optimal solution formed with the remaining items. We then use the information from 
random sampling to compute a proper threshold t for the rest of items. Specifically, we find a subset 
S* C A \ T with the largest difference between its value and cost, multiplied by the threshold t (in the 
computation of S*, if there are multiple choices, we break ties by any given fixed order). Finally, we use 
the property of XOS functions to find a linear representation of v{S*) and run a truthful mechanism 
for linear functions with respect to S*. 

The mechanism is designated for XOS functions; it is also used crucially as an auxiliary procedure 
for the more general subadditive functions in the subsequent sections. Note that the runtime of the 



mechanism for general XOS functions is exponentiajj. 

Note that in Step (4), the function v{S)—t-c{S) that we maximize is simply the Lagrangian function 

v{S) - X ■ c{S) + X-B 

(note that x-B is a fixed constant) of the original optimization problem maXg v{S) subject to c{S) < B. 
While we do not know the actual value of the variable x in the Lagrangian, a carefully chosen parameter 
t in the sampling step with a high probability ensures that maxg \^v{S) — t-c{S) + t- B^ gives a constant 
approximation of the optimum maxg {u(5') — x ■ c{S) + x ■ B^ of the Lagrangian, which is precisely the 
targeted value v{opt{A)). 

The linearity of the Lagrangian, together with the subadditivity of the valuations, is important 
in order to derive the following properties. (The threshold t, subset S*, and additive function / are 
defined in the XOS-RANDOM-sample.) 

Claim 3.1. For any S C 5*, f{S) - t ■ c{S) > 0. 

Proof. Suppose by a contradiction that there exists a subset S Q S* such that f{S) — t ■ c{S) < 0. 
Let S' = S* \ S. Since / is an additive function, we have c{S') + c{S) = c{S*) and f{S') + f{S) = 
f{S'uS) = f{S*) = v{S*). Thus, 

v{S') - t ■ ciS') > f{S')-t-c{S') 

= v{S*)-t-ciS*)-{fiS)-t-ciS)) 
> v{S*)-t-c{S*), 

which contradicts the definition of 5*. D 

The following claim says that any item in 5* cannot manipulate the selection of the set S* if bidding 
a smaller cost. This fact is critical for the monotonicity, and thus, the truthfulness of the mechanism. 

Claim 3.2. If any item j € S* reports a smaller cost b{j) < c{j), then set S* remains the same. 

Proof. Let b be the bid vector where j reports b{j) and others remain unchanged. First we notice that 
for any set S with j G S, [v{S) — t ■ 6(5)) — [v{S) — t ■ c{S)) = t(^c{j) — b{j)) is a fixed positive value. 
Hence, 

v{S*)-t-b{S*) = v{S*)-t-c{S*)+t{c{j)-b{j)) 
> v{S)-t-c{S)+t{c{j)-b{j)) 
= v{S)-t-b{S). 

Further, for any set S with j ^ S, we have 

v{S*) - t ■ b{S*) 



> v{S*) 


-t-c{S 


> v{S)- 


-t.c{S) 


= v{S)- 


- t ■ b{S) 



^In fact, in the second step of the mechanism, we can use any constant approximation solution (e.g., algorithm 
SA-ALG-MAX established in Section l33|) . which suffices for our purpose. Further, Step (4) can be done by simply 
asking a demand query. Hence, the mechanism can be implemented in polynomial time, if we have access to an 
oracle that, for any subset X of items, gives a linear function / with f{X) = v{X) and f{S) < v{S) for each 
sex. For some classic XOS problems like matching (the value of a subset of edges is the size of the largest 
matching induced by them), our mechanism can be implemented in polynomial time. 



Therefore, we conclude that S* = argmax [v{S) — t ■ b{S)); and by the fixed tie-breaking rule, S* is 

SCA\T 
selected as well. D 

Our main mechanism for XOS functions is simply a uniform distribution of the mechanism XOS- 
RANDOM-SAMPLE and one that always picks an item from argmaXjf(z). 



XQS-MECHANISM-MAIN 

• With half probability, run XOS-RANDOM-SAMPLE. 

• With half probability, pick a most-valuable item as the only winner and pay him B. 



Theorem 3.1. The mechanism XOS-mechanism-main is budget feasible and truthful, and provides a 
constant approximation ratio for XOS valuation functions. 

In the remaining of this section, we will prove the theorem. It follows from the following three 
lemmas. 

Lemma 3.1. XOS-mechanism-main is universally truthful. 

Our mechanism, at a high level point of view, has a similar flavor to the mechanism composition 
introduced in [T]. In particular, we may consider Steps (1-4) as one mechanism of choosing candidate 
winners and Steps (5-7) as the other restricted on the survived agents; then the whole mechanism is 
a composition of the two. It was shown in [T] that if the first mechanism is composable (i.e., truthful 
plus the property that any winner cannot manipulate the winner set without losing) and the second 
one is truthful, then the composite mechanism is truthful. In our mechanism XOS-MECHANISM-MAIN, 
composability of Steps (1-4) follows from Claim [3^ and truthfulness of Steps (5-7) is by the property 
of Additive-mechanism. Therefore, the mechanism is truthful. 

Lemma 3.2. XOS-mechanism-main is budget feasible. 

In the mechanism XOS-RANDOM-SAMPLE, the payment to each winner is the maximum amount 
that the agent can bid and still win. This amount is the minimum of the threshold bids in each of 
the intermediate steps (e.g.. Step (4) and (6)). In particular, the payment is upper bounded by the 
threshold of the mechanism Additive-mechanism in Step (6). As Additive-mechanism is budget 
feasible jl4] . our mechanism XOS-random-sample is budget feasible as well. Finally, picking the 
largest item and paying it the whole budget are clearly a budget feasible mechanism. 



Lemma 3.3. XOS-mechanism-main has a constant approximation ratio 



Proof. Let opt = opt{A) denote the optimal winning set given budget B, and let k = minjgopt ^^°^ ' 



Thus u(opt) > k • v{i) for each i E opt. By Lemma 1 2. 11 we have u(opt Cl T) > -jrrv{opt) with a 
probability of at least ^. Thus, we have 7;(opt(T)) > u(opt PI T) > ■^^t>(opt) with a probability of at 
least ^ (the first inequality is because opt nT is a particular solution and opt(r) is an optimal solution 
for set T with the budget constraint). 

We let opt* = opt r(S'*) be the optimal solution with respect to the item set S*, additive value- 
function / and budget B. In the following we show that /(opt*) is a good approximation of the actual 
social optimum f (opt). Consider the following two cases: 



• 



c{S*) > B. With such assumption, we can always find a subset S' C S* , such that ^ < c{S') < B. 
By Claim EH we know f{S') > t ■ c{S') > ^^i^|^ • f > Eisi^, Then by the fact that 
opt* is an optimal solution and S' is a particular solution with budget constraint B, we have 
/(opt*) > f{S') > h(£^I)) > |=^7;(opt) with a probability of at least i. 

c(5*) < B. Then opt* = S*. Let S' = opt\r; thus, c{S') < c(opt) < B. By Lemma EH we have 
"^(5") > ^^'y(opt) with a probability of at least ^. Recall that S* = argmax5Cyi\r(^('S') — ^•c(5')). 
Then with a probability of at least 2, we have 

/(opt*) = /(5*) = viS*) 

> v{S*) - t ■ c{S*) 

> v{S') - t ■ c{S') 

k-l , , viovtlT)) 

> — ^u(opt - ^ ^ ^ ^^ • B 

Ak ^ ^ ' 8B 

k — 1 , , w(opt) 

> — ^^^(opt ^-^-^ 

4k ^ ^ ^ 8 



k-2 . . 
^^^^(opt). 



In either case, we get 



/(opt*) > min <> — — — f(opt), — ; — w(opt) > > — — — f(opt) 



with a probability of at least ^. At the end we output the result of Additive-mechanism(/, S*, B) in 
the last step of XOS-RANDOM-SAMPLE. We recah that Additive-mechanism has an approximation 
factor of at most 3 with respect to the optimal solution /(opt*). Thus the solution given by XOS- 
RANDOM-SAMPLE is at least i • /(opt*) >\-\- l^u(opt) = ^||u(opt). 

On the other hand, since k = miujgopt "wfy^i the solution given by picking the largest item sat- 
isfies maxjf(i) > ■^u(opt). Combining the two mechanisms together, our main mechanism XOS- 
MECHANISM-MAIN has a performance of at least 

I k-2 1 1\ , , k + 'i%2 , , I , , 
+ o ■ T "wiopt) = — t;(opt) > — — ?;(opt). 



2 384fc 2 kj ' ^ ' 768A; ' ^ ' " 768 
This completes the proof of the lemma. D 

3.2 Integrality- Gap Approximations for Subadditive 

Next we use our result for XOS functions to design a truthful mechanism for subadditive functions. Let 
Si, . . . , Sn be a permutation of all possible subsets of A, where A^ = |2 | is the size of the power set 
2 . We consider the following linear program for each subset 5" C A, where each subset Sj is associated 
with a variable aj. 

N 
LP{S): min ^aj-v{Sj) (0) 

s.t. aj > 0, 1<3<N 

y Oj > 1, y i & s 
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In the above linear program, the minimum is taken over all possible non-negative values of a = 
(ai, . . . , ttAf). If we consider each Oj as the fraction of the cover by subset Sj, the last constraint 
implies that all items in S are fractionally covered. Hence, LP(S') describes a linear program for 
the set cover of S. For any subadditive function v{-), it can be seen that the value of the op- 
timal integral solution to the above LP(S') is always v{S). Indeed, one has S C \J. „.>|S'j and 

E, «. • V{S,) > Ej: „,>! v{Sj) > ^ u,. «,>1 Sj) > V{S). 

Let v{S) be the value of the optimal fractional solution of LP(S'), and T{S) = ^-ql be the integrality 



gap of LP (5). Let I = maxscA^iS); the integrality gap I gives a worst case upper bound on the 
integrality gap of all subsets. Hence, we have -^^ < v{S) < v{S) for any S '^ A. The classic Bondareva- 
Shapley Theorem [9l|34j says that the integrality gap I{S) is one (i.e., v{S) is also an optimal fractional 
solution to the LP) if and only if v{-) is an XOS function. 

Lemma 3.4. v{-) is an XOS function. 

Proof. For any subset S ^ A, consider any non- negative vector 7 = (71,..., 77V) > that satisfies 
Ej: iGS ^i — 1 ^°^ ^^y i & S. Then, we have 



N N / N 

3 = 1 3 = 1 '•'- \k=l 



y i E Sj, 






N N 



- \j=i fc=i 



k: ieSk 



N , N . 



\k=l ^J=l 
/ N 

^ \fe=l 



V.7,V*e5„ Y. 1^^^^^^ 



k: i£Sk 



V^e5, E "fc>l) 

k: ieSk / 



= v{S) 
The inequality above follows from the fact that for any i G S", 

k: i&Sk j j k: iGSk j j: ieSj 

Hence, v{-) is fractionally subadditive, which is equivalent to XOS. D 

We are now ready to present our mechanism for subadditive functions. 



SA- 


VIECHANISM- 


MAIN 




















1 


For each 


subset S' C j4, compute v(S). 




















2 


Run XOS 


-MECHANISM-MAIN for the instance 


with 


respe 


ct 


to 


the 


XOS 


function 


«(•)• 


3 


Output the result of XOS-MECHANISM- 


MAIN 



















Theorem 3.2. The mechanism SA-MECHANISM-MAIN is budget feasible and truthful, and provides an 
approximation ratio of 0{I) for subadditive functions, where I is the largest integrality gap of LP{S) 
for all S <^A. 
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Proof. Note that the valuation v{-) is public knowledge and utilities of agents do not depend on v{-); 
thus computing v{-) and running XOS-MECHANISM-MAIN with respect to v{-) do not affect truthfulness. 
The claim then follows from Theorem 13.11 and the fact that -y^ < v{S) < v{S) for any S ^ A (i.e., by 
using v{-) instead of f (•) we lose at most factor of X in the approximation ratio). D 

In general, the approximation ratio of the mechanism can be as large as 0(logn) |19t [H]. But for 
those instances when the integrality gap of (0) is bounded by a constant (e.g., facility location [33]). 
our mechanism gives a constant approximation. 

3.3 Sub-Logarithmic Approximations for Subadditive 

In this section, we give another mechanism for subadditive functions based on the ideas of random 
sampling and cost sharing. In contrast to the previous section, the mechanism runs in polynomial time 
and has an o(logn) approximation ratio, improving the previously best known ratio 0(log n) [20]. Our 
mechanism relies on a constant factor approximation algorithm for subadditive function maximization 
under a knapsack constraint, which may have its own interest. 

3.3.1 Subadditive Maximization w^ith Budget 

We first give an algorithm that approximates max^^-^ "^{S) given that c{S) < B. That is, we ignore for 
a while strategic behaviors of the agents and consider a pure optimization problem. Dobzinski et al. [20] 
considered the same question and gave a 4-approximation algorithm for the unweighted case (i.e., the 
restriction is on the size of a selected subset). Our algorithm extends their result to the weighted case 
and runs in polynomial time if we are given a demand oraclqj. 



SA-ALG-MAX 




• Let V* = u\a,-Ki(zAv{i) and V = {w*, 2w*, . . . , nw*} 




• For each u G V 




- Set p{i) = ^ ■ c{i) for each i £ A, and find T G argmax (u(S') - 

SCA 


-E^esPi^))- 


- Let 5*1, = . 




— If v{T) < |, then continue to next v. 




— Else, in decreasing order of c{i) put items from T into Sv 


while preserving 


the budget constraint . 




• Output: Sy with the largest value v(Sy) for all v €z V . 





Lemma 3.5. SA-alg-max is an 8 -approximation algorithm for subadditive maximization given a 
demand oracle. 

Proof. Let S* be an optimal solution. Note that v(S*) > v* = ina.Xi^Av{i) and c{S*) < B. For all 
V < v{S*), we first prove that the algorithm will generate a non-empty set Sy with v{Sy) > |. Since T 
is the maximum set returned by the oracle, we have 

v{T) - —c{T) > v{S*) - —c{S*) >v- — -B>- 
\ J 2B ^ ' - ^ ' 2B ^ ' - 2B - 2 



^Independent to our work, Badanidiyuru et al. |4] gave a 2 + e approximation algorithm to the same weighted 
problem. 

12 



Hence, v{T) > |. If c{T) < B, then S^ = T and we are done. Otherwise, by the greedy procedure 
of picking items from T to 5"^,, we are guaranteed that c{Sy) > ^. Assume for contradiction that 
v{Sy) < |. Then 

v{T\S,)-^c{T\S,) > v{T)-v{S,)-^{c{T)-c{S,)) 

= v{T)-—c{T) 
^ ' 2B ^ ' 

The later contradicts to the definition of T, since T \ S^ is then better than T. Thus, we always 
have v{Sv) > | for each v < v{S*). Since the algorithm tries all possible f € V (including one with 

^2 < V < v{S*)) and outputs the largest v{S^), the output is guaranteed to be within a factor of 8 
to the optimal value v{S*). D 

Note that we can actually modify the algorithm to get a (4 + e)-approximation with running time 
polynomial in n and -. To do so one may simply replace V by a larger set {ev*, 2ev*, . . . , [^]et;*}. 
Both algorithms suffice for our purpose; for the rest of the paper, for simplicity we will use the 8- 
approximation algorithm to avoid the extra parameter e in the description. 

We will use SA-ALG-MAX as a subroutine to build a mechanism SA-random-sample for subad- 
ditive functions in the next subsection. When there are different sets maximizing v{S) — X^jg^pl^), 
we require that the demand query oracle always returns a fixed set T. This property is important 
for the truthfulness of our mechanism. To iinplement this, we set a fixed order on all the items 
ii < 12 < ■ ■ ■ < in- We first compute 

Ti € argmax {y{S) — > pii)) and T2 € argmax {v{S) — > p{i)) ■ 

SCA ^ SCA\{^,} ^ 

If v{Ti) — Ylii(^TiPii) ~ ^(^2) — Z]iGT2^(^)' ^^ know that there is a subset without ii that gives us 
the maximum; thus, we ignore ii for further consideration. If v{Ti) — YlieT ?'(^) ^ ^(^2) — SjgT Pii)^ 
we know that ii should be in any optimal solution; hence, we keep ii and proceed with the process 
iteratively for i2; ^3, • • • , in- This process clearly gives a fixed outcome that maximizes v{S) — X^jg^ pI*)- 

3.3.2 Mechanism 

Let us first consider the following mechanism based on random sampling and cost sharing. 



13 



SA-RANDOM-SAMPLE 

1. Pick each item independently at random with a probability of i into group T. 

2. Run SA-ALG-MAX for items in group T , and let v be the value of the returned 
subset . 

3. For fc = 1 to |^\T| 

• Run SA-ALG-MAX on the set {i ^ A\T \ c{i) < ■§} where each item has cost -^ , 
denote the output by X . 

• If -w>Sf-' 

— Output X as the winning set and pay -^r to each item in X . 

- Halt. 

4. Output 0. 



In the above mechanism, we again first sample in expectation half of the items to form a testing 
group r, and then use SA-ALG-MAX to compute an approximate solution for the items in T given the 
budget constraint B. As can be seen in the analysis of the mechanism, the computed value v is in 
expectation within a constant factor of the optimal value of the whole set A. That is, we are able to 
learn the rough value of the optimal solution by random sampling. Next we consider the remaining 
items A\T and try to find a subset X with a relatively big value in which every item is willing to 
"share" the budget B at a fixed share -^. (This part of our mechanism can be viewed as a reversion 
of the classic cost sharing mechanism.) Finally, we use the information v from random sampling as a 
benchmark to determine whether X should be a winning set or not. 

The final mechanism for subadditive functions is described as follows. 



SA-MECHANISM-MAIN-2 

• With half probability, run SA-RANDOM-SAMPLE. 

• With half probability, pick a most-valuable item as the only winner and pay him B. 



Theorem 3.3. SA-MECHANISM-MAlN-2 runs in polynomial time given a demand oracle and is a truth- 
ful budget feasible mechanism for subadditive functions with an approximation ratio o/0( j "j^" ). 

The proof of the Theorem 13.31 is given in the appendix. 

4 Bayesian Mechanism Design 

In this section, we study budget feasible mechanisms for subadditive functions from a standard eco- 
nomics viewpoint, where the costs of all agents {c{i))i^A are drawn from a prior known distribution T>. 
More specifically, the mechanism designer and all participants know "D in advance from which the real 
cost vector (c(i))jg^ is drawn. However, each c(z) is the private information of agent i. Distribution 
P is given on the probability space Q with the corresponding density function p(-) on W '. We allow 
dependencies on the agents' costs in T> and consider the distributions that have integrable marginal 
densities for any subset of variableqj; this includes, e.g., independent distributions as special cases. 



®We need some mild technical restriction on T> in order to sample a conditioned random variable. We assume 
that the density function p{-) of T> is integrable over each subset 5 C A of its variables for any choice of the rest 
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Every agent submits a bid b{i) as before and seeks to maximize his own utility. We again con- 
sider universally truthful mechanisms, i.e., for every coin flips of the mechanism and each cost vec- 
tor, truth-telling is a dominant strategy for every agent. The performance of a mechanism A4 is 
measured by E[A^] = Ec^x>[A^(c)]. We compare a mechanism with the optimal expected value 
E[opt] = Ec^x)['y(opt(c))] ; we say mechanism A4 is a (Bayesian) a-approximation if ^wf — ^■ 

In this section: Let opt^,(c, S) denote the winning set in an optimal solution when the valuation 
function is f (•), the cost vector is c, and the agent set is S (the parameters are omitted if they are clear 
from the context); let z;(opt^(c, S)) denote the value of opt^(c, S). 

Our mechanism is as follows. 



SA-Bayesian-mechanism 

• With a probability of ^, let a most-valuable item be the only winner and pay him B. 

• With a probability of ^ run the following: 

1. Pick each item independently at random with a probability of i into group T. 

1. Compute an optimal solution opt(c, T) for items in T given budget B. 

3. Set a threshold t = ^iSS^^^Dl. 

4. For items in ^ \ T find a set S** G argmax {w(S') — t • c(5)}. 

SCA\T 

5. Sample a cost vector d ^ V conditioned on 

(a) d{i) = c{i) for each i Cz T , and 

(b) S* e'Aigm'Ax{v{S)-t-d{S)}. 

SCA\T 

6. If d(S*) < B , let all i ^ S* with c(i) < d{i) be the winners. 

7. If d{S*) >B, 

- run XOS-MECHANISM-MAIN w.r.t. valuation «(•), set S* , cost c(-), budget B. 

- Output the result of XOS-MECHANISM-MAIN. 



In the mechanism, Steps (1-3) are the same as XOS-random-sample where we randomly sample 
a test group T and generate a threshold value t. In Steps (4-7), we consider a specific subset S* C A\T 
and select winners only inside of it. Step (5) helps to give us a guidance on the threshold payments of 
the winners (see more discussions below). Step (7) runs XOS-mechanism-main on the function ■;;(•) 
(defined as the optimal value of the LP (0)), which is XOS according to Lemma |3.4[ 

A few remarks about the mechanism are in order. 

• It is tempting to remove the random sampling part, as given V one may consider a 'prior sampling' 
approach: Generate some virtual instances according to T> and compute a threshold t based on 
them; then apply this threshold to all agents in A. Interestingly, the prior sampling approach 
works well in our mechanism when, e.g., all c(i)'s are independent, but it does not work for the 
case when variables are dependent. 

For instance, consider an additive valuation v{-) with v{S) = \S\, budget B = 2^ for a large fc, 
and a set of A^ = 2 agents with the following discrete distribution over costs (c = £ means that 



parameters, i.e., p{ca\s) = /n p{c)dxs is bounded. This condition is reminiscent of integrability of marginal 
density functions (see, e.g., page 331 of 06]), though in our case we require a slightly stronger condition. 
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every c(i) = i): 




Pr[c=l] = 2.+rPr[c = 2] = 2,,.... 


..,Pr[c = 2'=] = -,Pr[c 


Note that 




v{opt{c= 1)) = 2'=,u(opt(c = 2)) = 2^-^.. 


....,i;(opt(c = 2^')) =1, 



ofc+ll _ -^ 



.pt(c = 2'=+i)) =0. 

Then the expected optimal value is E[opt] = -i^ and it is equally spread over all possible costs 
except the last one c = 2*'"'"^. Roughly speaking, on a given instance c, any prior estimate on 
u(opt(c)) that gives a constant approximation only applies to a constant number of distinct costs 
(the contribution of these cases to E[opt] is negligible). Hence for almost all other possible 
costs, we get a meaningless estimate for opt(c). Therefore, the prior sampling will lead to a bad 
approximation ratio. 

• Why do we generate another cost vector d in Step (5)? Recall that our target winner set is 5*, 
whose value f (5"*) in expectation gives a constant approximation of E[opt]. However, we are faced 
with the problems of selecting a winning set in S* with a sufficiently large value and distributing 
the budget among the winners. These two problems together are closely related to cooperative 
game theory and the notion of approximate core. For subadditive functions, a constant approxi- 
mate core may not exist [33] (e.g., set cover gives a logarithmic lower bound [8]). Thus we might 
not be able to pick a winning set with a constant approximation and set threshold payments in 
accordance with the valuation function. The question then is: Is there any other guidance we can 
take to bound budget feasible threshold payments and give a constant approximation? 

Our solution is to use another random vector d to serve as such a guidance. (Conditions in 
Steps ([5a|) and (|5bp. from a high level point of view, guarantee that the vector d is not too 'far' 
from c for the agents in 5*, in the sense that both vectors are derived from the same distribution. 
Thus, cost vectors c and d are distributed symmetrically and can be switched while preserving 
some important parameters such as t and S* in expectation.) If d{S*) < B (Step (6)), then we set 
d{i) as an upper bound on the payment of each agent i £ S*; this guarantees that we are always 
within the budget constraint. If d{S*) > B, setting d{i) as an upper bound is not sufficient to 
ensure budget feasibility; then we adopt our approach for XOS functions with inputs subset 5* 
and XOS valuation v{-) defined by (0)- 

Theorem 4.1. SA-Bayesian-mechanism is a universally truthful budget feasible mechanism for sub- 
additive functions and gives in expectation a constant approximation. 

Budget feasibility follows simply from the description of the mechanism and the fact that XOS- 
MECHANISM-MAIN is budget feasible. 

For universal truthfulness, we note that in the mechanism, the sampled vector d comes from a 
distribution that depends on actual bid vector c. To see why our mechanism takes a distribution 
over deterministic truthful mechanisms, we can describe all possible samples d for (i) all possible cost 
vectors on T and (ii) all possible choices S C A\T oi S*; then we tell all flipped d's to the agents before 
looking at the costs of T. (Practically, we can provide all our randomness as a black box accessible by 
all agents.) Note that the selection rule of S* is monotone, and, similarly to Claim [321 each agent in S* 
cannot manipulate (i) the composition of S* given c and T, and (ii) the choice of d, as long as he stays 
in 5*. Therefore, composing the first part choosing S* (Step (4)) with the next monotone rule picking 
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winners in S* (Steps (6-7)), we again get a monotone winner selection rule. Hence, the mechanism is 
universally truthful. 

Next we give a sketch of the idea of proving the constant approximation. Details of the proof are 
deferred to the Appendix iBl 

Approximation analysis (sketch). We sketch the proof idea of the approximation ratio of the mechanism. 
First, similar to our analysis in Section [3.11 the optimal solution v ( opt (c,T)) obtained from random 
sampling in expectation gives a constant approximation to the optimal solution E[opt]. Further, we 
observe the following facts (which are reminiscent of Claim I3.ip : 

v{S) - t ■ c{S) > and v{S) - t ■ d{S) > 0, V5 C S* 

where the second inequality is based on the conditional distribution we choose for d. 

If c(5*) > B and d{S*) > B (i.e., the mechanism runs Step ©), we can pick a subset 5*° C S* 
with B > c(5°) > -|. By Theorem 13.11 XOS-mechanism-main gives a constant approximation to 
the optimum of v(-) on S*. (This is the reason why in Step (7) of the mechanism, we run the whole 
XOS-MECHANISM-MAIN ou the input instance v{-) and S*.) Hence, 

v{opt,{c, S*)) > v{S') > t ■ c(5°) > t . I > ^^milll, 

where the first inequality follows from the fact that 5" C 5* is a budget feasible set. Thus, the optimum 
of u(-) on S* is within a constant factor of u(opt(c, T)), as well as the benchmark E[opt]. 

If c{S*) < B and d{S*) > B, we have v{S*) > t ■ d{S*) > ^dSI^^:!)!, Further, we notice that 
5"* is budget feasible with respect to cost vector c; thus, XOS-mechanism-main gives a constant 
approximation to v{S*), which in turn is within a constant factor of f (opt(c, T)) and E[opt]. 

We observe that the vectors d and c are restricted to the agents in S* and conditioned on 

S* € argmax {u(5) — t ■ d{S)} and S* € argmax {f (5) — t ■ c{S)} 

SCA\T SCA\T 

have exactly the same distributions. Therefore, due to such a symmetry between d and c, in a run of 
our mechanism in expectation we will have the outcome T, t, S* and a pair of vectors (c, d) as often as 
the outcome T, t, S* and the pair (d, c). This implies that in the case when d{S*) < B and c{S*) < B, 
we get on average a value of at least ^v{S*), since (i) the winning sets on the two instances where c 
(resp., d) is the private cost and d (resp., c) is the sampled cost altogether cover S*, and (ii) ?; is a 
subadditive function. By the choice of threshold t, we also know that 

v{S* 



> v{S*) - t ■ c{S*) 




> v{opt{c,A\T))- 


-t-c{opt{c,A\T)) 


> v{oj>t{c,A\T))- 


-t-B. 



Thus, our mechanism gives a constant approximation to t'(opt(c)) with some constant probability. 

The last case is when c{S*) > B and d{S*) < B. Again due to the symmetry between c and d, 
intuitively, we can treat this case as the above one when c and d are switched; thus we also get a 
constant approximation of E[opt]. (The formal argument, however, due to multiple randomness used 
in the mechanism, is much more complicated.) 

Therefore, the mechanism SA-Bayesian-mechanism on average has a constant approximation of 
the expected socially optimal value E[opt]. D 
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5 Conclusions 

Our work considers budget feasible mechanism design in two analysis frameworks: prior- free and Baye- 
sian. For XOS functions, we give a prior-free constant approximation mechanism. For subadditive 
functions, we present two prior-free mechanisms with integrality-gap and sub-logarithmic approxima- 
tions, respectively, as well as a Bayesian constant approximation mechanism. All our mechanisms are 
universally truthful. 

Our mechanisms continue to work for the extension when the valuation functions are non-monotone, 
i.e., v{S) is not necessarily less than v{T) for any S" C T C ^4. For instance, the cut function studied 
in |20] is non-monotone. For such functions, we can define v{S) = max^^g v{T) for any S (^ A. It 
is easy to see that v{-) can be computed easily given a demand oracle, is monotone, and inherits the 
classification of v{-). Further, any solution maximizing v{-) is also an optimal solution of v{-). Hence, 
we can apply our mechanisms to v{-) directly and obtain the same approximations. 

We give a constant approximation mechanism for subadditive functions in the Bayesian framework 
where the costs are drawn from a given known distribution. Considering the gap between Bayesian 
and prior-free, a natural question is under which frameworks a constant approximation mechanism still 
exists. An interesting step along this direction is the prior-independent setting, where the costs are still 
drawn from an underlying distribution, but the mechanism designer does not have the prior knowledge 
of it. Our mechanism SA-Bayesian-mechanism can be adopted to the framework where all the costs 
are identically and independently distributed. (Specifically, by random sampling we are able to learn 
the underlying unknown distribution with sufficient precision.) However, we do not know how to handle 
independent but not necessarily identical distributions in the prior-independent framework, as well as 
the most general prior-free setting in the worst-case analysis. 

Indeed, whether subadditive functions admit a prior-free constant approximation mechanism still 
remains an open problem. Our results show a separation between XOS and subadditive functions. 
Another angle to have such a distinction between the two classes is from exponential concentration: In 
the case of XOS the valuation of a randomly selected subset obeys an exponential concentration around 
its expected valuqj, whereas in the case of general subadditive valuations it does not (see [39] for a 
counterexample). Such a difference on exponential concentration may suggest a possible distinction be- 
tween XOS and subadditive functions in terms of their approximability in (budget feasible) mechanism 
design (see appendix O for more details). 

For those mechanisms with exponential runtime, it is natural to ask if there are truthful designs with 
the same approximations that can be implemented in polynomial time. Further, all of our mechanisms 
are randomized; it is intriguing to consider the approximability of deterministic mechanisms. We leave 
these questions as future work. 
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^Note that this fact can be used to improve the approximation ratios of the mechanisms of XOS functions 
substantially (but still up to a constant factor). 
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A Proof of Theorem [33] 

Proof. Let S = A\T. It is obvious that the mechanism rmis in polynomial time since SA-alg-max is 
in polynomial time. If the mechanism picks the largest item, certainly it is budget feasible as the total 
payment is precisely B. If it chooses SA-random-sample, either no item is a winner or X is selected 
as the winning set. Note that |X| < /c and each item in X gets a payment of -^. It is therefore budget 
feasible as well. 

(Truthfulness.) Truthfulness for picking the largest item is obvious (as the outcome is irrelevant to 
the submitted bids). Next we will prove that SA-random-sample is truthful as well. The random 
sampling step does not depend on the bids of the items, and items in T have no incentive to lie as they 
cannot win anyway. Hence, it suffices to only consider items in S. Observe that every agent will be a 
candidate to the winning set only if c{i) < -^. Consider any item i G 5 and fixed bids of other items. 
There are the following three possibilities if i reports his true cost c(i). 
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Item i wins with a payment -^. Then we have c{i) < -^ and his utiUty is -^ — c{i) > 0. Hi reports 



a bid which is still less than or equal to jr, the output and all the payments do not change. If i 



reports a bid which is larger than -^ , he still could not win for a share larger than -^ and will not 
be considered for all smaller shares. Therefore, he derives utility. Thus for either case, i does 
not have incentive to lie. 

• Item i loses and payment to each winner is -^ > c{i). In this case, if i reduces or increases his 
bid, he cannot change the output of the mechanism. Thus i always has zero utility. 

• Item i loses and payment to each winner is -^ < c{i) or the winning set is empty. In this case, if 
i reduces his bid, he will not change the process of the mechanism until the payment offered by 
the mechanism is less than c(i). Thus, even if i could win for some value k, the payment he gets 
would be less than c{i), in which case his utility is negative. If i increases his bid, he lose and 
thus derives zero utility. 

Therefore, SA-random-sample is a universally truthful mechanism. 

(Approximation Ratio.) It remains to estimate the approximation ratio. Let opt = opt (A) denote the 
optimal solution for the whole set. 

If there exists an item i ^ A such that v{i) > 2i'(opt), then picking the largest item will generate 
a value at least 2''^(op't) and we are done. In the following, we assume that v{i) < 2'y(opt) for 
all i € A. Then, by Lemma 12.11 with probability at least ^ we have f (opt(T)) > gt!(opt) and 
v{opt(S)) > gf(opt). Hence, with probability at least j we have 

viopt{S))>v{optiT))>^v{opt). (1) 

Therefore, it suffices to prove that the main mechanism has an approximation ratio of Q( io°io"n ) Si'^^n 
the inequalities ([I]). 

Since SA-alg-max is an 8 approximation of t;(opt(T)), we have v > iv(opt(T)) > gjw(opt). 
Clearly, if SA-random-sample outputs a non-empty set, then its value is at least ^^^ •'V > 5 °|o °o \ ■ 
i;(opt). Hence, it remains to prove that the mechanism will always output a non-empty set given 
formula ([T]). 

Let S* = {1, 2,3, . . . ,m} C 5* be an optimal solution of S given the budget constraint B and 
ci > C2 > ■ ■ ■ > Cm- We recursively divide the agents in S* into different groups as follows: 

• Let ai be the largest integer such that ci < — . Put the first min{ai,?7i} agents into group Zi. 

• Let Pr = di + ■ ■ ■ + ttr- li Pr < fn let ar+i be the largest integer such that c^^_|_i < - — -; put the 
next min{ar+i, w, — /3,.} agents into group Zr+i- 

Let us denote by x -|- 1 the number of groups. Since items in S* are ordered by ci > C2 > • • • > Cm, 

-Og log n 
10 log n 

does not output an empty set, as it could buy aj items at price — given that SA-ALG-MAX is an 
8-approximation and the threshold we set is v{Zj) > gm°^^ ■ v. Thus, we may assume that v{Zj) < 
101°^" ' ^ ^'-'^ each j = 1, 2, . . . , x -|- 1. On the other hand, by subadditivity, we have 

x+l 

^v{Zj) > v{S*) = v{o-pt{S)) > f(opt(r)) > V. 
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we have a^+i > Ur for any r. If there exists a set Zj such that v{Zj) > °m°^" • v, then the mechanism 



Putting the two inequalities together, we can conclude that (x + 1) • °m°^^ ■ v > v, which implies that 



5 log n 5 log m 

X > : > 



log log n log log m 

On the other hand, since S* = {1, 2, 3, ... , m} is a solution for S within the budget constraint, we 
have that Yl]Li Cj < B. Further, since ci > ^^, Cg^^, > ^^, . . . , c^^^^ > j^^^+i , we have 

m, 

B > J] Cj > ci + aic^^^i + • • • + axc^,+i 



B a-iB OrB 



Hence, 



ai + 1 a2 + I Ox+i + 1 



1 Qi ttx 1 ai cto 

1> — + — + ■■■ + ^—>7^ + 7r^ + --- + 



ai + 1 a2 + 1 ttx+i + 1 2ai 2a2 2aa;+i 

In particular, we get 

„ . 1 tti , , ax-i ^ xl I ai aa;_i 

2 > \ \ \ > X \ 



ai 02 dx V en ct2 Ox 

where the last inequality is simply the inequality of arithmetic and geometric means. Hence, we get 
2 > a; w ^, which is equivalent to ax > (f )^- Now plugging in the fact that m > ax and x > y°i^I^ , 
we come to a contradiction. This concludes the proof. D 

B Analysis of SA-Bayesian-mechanism 

In this section, we will give a formal proof for the constant approximation of SA-Bayesian-mechanism. 
We first have the following observation. 

Claim B.l. For any S C S* , v{S) - t ■ c{S) > 0. 

Proof. Indeed, recall that S* = argmax {f (S) — t ■ c{S)} . Then v{S) — t • c{S) > for any S C. S*, since 

SCA\T 

otherwise, we have v{S) — t ■ c{S) < for some 5 C S* and we get 

v{S* \ S) - t ■ c{S* \ S) > v{S*)-v{S)-t-c{S*\S) 

= v{S*) - t ■ c{S*) - {v{S) - t ■ c{S)) 
> v{S*)-t-c{S*), 

a contradiction. 

Thus, for any S Q S*, v{S) > t ■ c{S). Therefore, in the description of LP{S), we have v{Sj) > 
t ■ c{Sj) for each j G [1,-/V]- Now substituting v{Sj) for c{Sj) in LP(S), we get the desired inequality 

v{s) = LP{s)>t-c{s). a 

We assume that no single item can have cost more than B in the cost vector c. We need some extra 
notations. We assume that the distribution D is given on the probability space with corresponding 
density function p{x) on W '. For a set T C ^, let Xj, be a point in W '. We will denote by 
p{Xj,) a distribution's density we get on the corresponding space W'^' by sampling x S W"^' from D and 
restricting it to T-coordinates of x. By p{x\xj.) we denote the conditional density, if we fix T-coordinates 
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of X to be the same as in x^. By opt(x, S) we denote the optimal value we can get from the set 5 C ^ 
on cost vector x with budget B. In order to shorten the notations sometimes we will omit x or S, in the 
latter case S = A; sometimes we take the optimum over valuation v instead of v, so to emphasis this we 
employ notation opt~(x, S). In the mechanism we compute set <S'*(c, T), which depends on the sampled 
set T and cost vector c. By XOS{c, S*) we denote the value we get from XOS-mechanism-main(c, S*) 
run on the set 5*, cost vector c and XOS valuation v{-) that solely depends on v{-). 

In the following we write explicitly the expected value of the second part of our mechanism. 

I W\^ [ fi^^y^T)p(^y\y = x\^;S*{x,T) = S*{y,T))dypix)dx, (2) 

jXOSicS*) ifdiS*)>B 

f{c,d,T) - 



where 



\v{S* n {i : c{i) < dii)}) iidiS*)<B, 
Swapping in ([2]) the sum and integral we get 



2l^ 



Ml 2^ 



TcA 



f{x,y,T)p(y y = x\^;S*{y,T) = S*{x,T) ) dyp(x)dx 



n n 



2\A\Y^ / f{x^y^'^)P\y XT'^S*{y,T) = S*{x,Tyj dy p[x 

TdA r^lrp\ CI O 



x„ ) dx pix ]dx 



n{T) n n 



^E / / E [f{x,y,T)p{y\x,;S*{y,T) = S*{x,T))dy 
tcaJ^, o S<zA\T o 



•Q.(T) Q ScA\T 



p{x\x^;S*ix,T) = S) ■Pr{S*{x,T) = S 



Xj,) dx p[x^]dx 



olAI 1^1^ 



2l^l 



^^^DJT) SCA\T 



'^n{T) 



f{x,y,T)p[y x^;S*{y,T) = S) dy ■ pix x^;S*{x,T) = S) dx 



.n Q 



Pr(s*{-,T) =S 



x„ ) pfxj, ) • dx. 



olAI 2^ 1^ 



2l^l 



f{x,y,T)+f{y,x,T) 



p{x\x^;S*{x,T) = S] dx Pr(S*{-,T) = S 



P[y x^;S*{y,T) = Sj dy 



Xj,] pixj,] ■ dx 



To get the first equality we split the integral w.r.t. variable x into two integrals w.r.t. variables 
Xj, € M'-^I and x conditioned on x = x^ on T; the second equality follows from the low of total 
expectation applied to the variable in the square brackets with conditioning on all possible values of 
random variable {S*{-,T)\Xj,}; to get the third equality we swap integral with the sum; to get the last 
equality we have used the symmetry between x and y for the expression in square brackets. Next, the 
formula (12]) can be written as 



2l^l E 

TcA 



f{x,y,T) + f{y,x,T) 



-p\y 



y = x\^;S*{x,T) = S*{y,T) ] dyp{x)dx, (3) 



n{x,T) 
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Now we estimate the value of XOS{c, S*) in the case when d{S*) > B. Recah that v{S) < v{S) for 
any set S Q A. According to the results of previous section for the XOS functions we have a constant 
approximation to the optimum: XOS{c, S*) > a ■ 'j;(opt~(c, S*)), for a positive constant a. In the next 
we consider two cases for c{S*). 

1. c(5*) < B. Since one can buy the whole set 5*, we have opt~(c, 5*) = S*. We have v{S*) > 
t ■ d{S*) by Claim [B?T] applied to the cost vector d. Hence, recalling the definition of t we get 
iy(opt~(c,5*)) > ^-^2S^§^B = -JSSI^, 

2. c(5*) > B. Since any single item in S* has cost less than B, we can find a set Sq C S*, such 
that B > c(S'o) > -J- We observe that u(optjj(c, 5*)) > v{S^), as Sq is a budget feasible set for 
the cost vector c. Then we have v{S^) > t ■ c{S^) by Claim IBTT] and v(oTpt~(c, S*)) > v{S^) > 



16 

Thus 



f{c,d,T)=XOSic,S*) > ^v{opt{c,T)), 

lb 



if d{S*) > B. By symmetry between c and d we have XOS{d, S*) > ^v{opt{d, T)), if c{S*) > B. We 
note that c coincides with d on T, and hence opt (c,T) = opt((i, T). Therefore, 

/(d,c,r) =X05((i,5*) > ^v{opt{c,T)), 

lo 

if c(5*) > B. 

In the following we estimate /(c, c?, T) + f{d, c, T). 

1. If either c{S*) > B oi d{S*) > B. We observe that due to the last inequalities for f{c,d,T) and 
f{d,c,T) 

/(c, d, T) + f{d, c, T) > ^v{opt{c, T)). 

lb 

2. If c{S*) < B and d{S*) < B, then by subadditivity of v we get 

/(c, d, T) + f{d, c, T) = v{S* n {i : c{i) < d{i)}) + v{S* D {i : c{i) > d{i)}) > v{S*). 

Hence we can write a lower bound on /(c, d, T) + f{d, c, T) 

/(c, d, T) + f{d, c, T) > min (v{S*), ^^(opt(c, T))) , 

which does not depend on d. We plug in this lower bound instead of f{c,d,T) + f{d,c,T) into the 
formula ^. 



J 21^1 ■^ 



^^^ n(2:,T) 



min(z;(y),§t;(opt(x,T))) / n 

^ i^ p\y y = x\^;S (x,T) = 5 {y,T) j dyp{x)dx = 

f 1 v^ fv(S*(x,T)) a , , ^,A , ,, 



TCA 



The equality holds, since y comes from probability distribution and the function under integral does 
not depend on y. 
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Let i*{x) be the most valuable item in A with c{i*) < B. We can write the following lower bound 
on the total valuation of SA-Bayesian-mechanism. 

I (0.5 X v{i^{x)) + 0.5 X -^ 5] min ( <S*{x,T)) ^ ^t;(opt(x,r)) ]) p{x)dx. 



n 
The optimal expected value is 



/ 



v{opt{x))p{x)dx. 



In the next we argue that function g{x) := v{i*{x)) + ^pjX^TcA™^^ { — 2' > ^^(°P"^(^' ^)) ) 
approximates f (opt(x)) within a constant factor for any cost vector x. 

We fix cost vector x. Let v{i*) = ■^u(opt), for some k > 1. We know that due to the Lemma l2.ll 
min (t;(opt(A \ T), ti(opt(r))) > ^^u(opt) at probability at least ^. For each T from the larger "good" 
half (i.e., for which previous inequality holds) we can write: 



v{opt{T)) > ^^^(opt) 



and 



vis*) > v{S*)-t-x{S*)>v{opt{A\T))-t-xio-pt{A\T)) 
k — 1 , , „ k — 1 , , ufopt) „ 

k-2 , , 
> ^^-(opt). 

The second inequality holds because S* € argmax|u(5) — t ■ a;(5')}; the third inequality holds 

5cA\r 

because the cost of feasible solution opt(^\T) is within the budget; in the forth inequality we plugged 
in the definition of t and used the fact that t;(opt) > v (opt(T)). 

Therefore, combining these two lower bounds for all "good" T we get 

, , ^ /I 1 . (k-2 (k-\)a\\ , , ,, 
1 / //c + 14 ka\\ , , ,, 

> i^v{o^X.{x)). 

Hence, we have shown that the expected value of SA-Bayesian-mechanism is within a constant 
factor of gY2 from the expected value of the optimal solution. 

C Concentration Bounds for XOS functions 

In this subsection we discuss a deep, but, on the other hand, conceptually simple, discovery in prob- 
ability theory [10], that has a direct application to our scenario. We recommend a short survey by 
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Vondrak [39j on the various applications of concentration inequalities for self-bounding functions in 
computer science. 

Here we adduce one more example and possibly one more point of view on this fascinating subject. 
Briefly in a simplified description the story is as follows. There is a set A of n elements and each of 
them is picked independently at random into a set T <Z A. This set T further receives a valuation 
v{T) given by a positive monotone function u : 2 — )• M. We note that when v is an additive function, 
elements of A naturally correspond to coins of diverse face values, which then is being tossed and tails 
are taken into T. When each coin has a small nominal relative to the total expected value, we get 
exponential concentration around expectation by a natural variant of the low of large numbers and 
Chernoff bounds (the standard formulation of LLN and consequently Chernoff bounds is for 0-1 coins 
and different probabilities of tails, whereas in our case the probabilities are all equal to 0.5 but values 
may vary). 

The most interesting part of the story is that one can generalize the exponential concentration to 
much broader classes of valuations. For instance v may be taken to be submodular or even fractionally 
subadditive. Then the concentration inequalities are as follows. 

Claim C.l ([39j). Let v(-) be positive monotone XOS function. // max^gyi u({z}) = vq, and Z = 
v{Xi, . . . , X|^|), where Xi G {0, 1} are independently random, then for any 5 > 0. 

. Vv[Z > {I + 5)nZ]\ < [j;^)~^ . 

• Pr[Z > (1 - 5)'E[Z]\ < e-0-5'5'E[2]^o. 

On the other hand, if one goes slightly further and considers subadditive valuations, then exponential 
concentration fails to be true (see [39] for counterexample). It is interesting to see one more sharp 
distinction between subadditive and fractionally subadditive valuations in a quite different mechanism 
design problem. 
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